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(57) Abstract: A method and apparatus for selectively applying image enhancement processing to parts of an image. In one em- 
bodiment. Spatial processing transformations, such as sharpening for example, are reduced or bypassed for pixels having color code 
values within a range known to be adversely affected by the spatial processing transformations. In another embodiment, color conec- 
2 tion processing transformations are bypassed for pixels having color code values within a neutral color range. These neutral colors 
may have a gray-correction transformation applied in order to better separate the neutral colors from the other colors. According 
^5 to another embodiment, color code values for pixels are transformed to two or more different color spaces. If a color correction 
^ transformation will have adverse affects on a pixel in one color space, corrected data from a different color space can be utilized for 
^ the pixel. 
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METHOD AND SYSTEM FOR SELECTIVE ENHANCEMENT 

OF IMAGE DATA 



This application claims the benefit of U.S. Provisional Application No. 
60/172,529, filed December 17, 1999, the disclosure of which is hereby 
incorporated herein by reference. 

TECHNICAL FIELD 

The present invention relates generally to digital image processing, and 
more particularly to a method and system for selective enhancement of image 
data. 

BACKGROUND OF THE INVENTION 

Digital imaging systems, such as scanners, digital cameras, and digital film 
processing systems, have been developed to create digital representations of 
images or scenes. Typically, the image or scene is represented as an array of 
pixels, each pixel being assigned one or more numerical values which describe 
the color of the part of the image or scene which the pixel represents. 

For a scanner, the image which is scanned may reside on any of a variety 
of media, including photographs, documents, slides, and film. Typically, the 
digital encoding process used by a scanner involves illuminating the image with 
a light source and recording the type and/or amount of reflected or transmitted 
light 
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As an example, a negative image on film can be scanned by transmitting 
a beam of white light through the film. In the case of color film, the light passing 
through the film is attenuated by individual dye layers. For each pixel, the 
transmitted light is passed through red. green, and blue filters, so as to describe 
5 the pixel in terms of its red, green, and blue characteristics. Such an RGB coding 
system is refen-ed to as a direct coding system, because each of the R. G. and 
B components (the color code values) for a pixel directly represents the 
respective R. G. or B component of the overall color for the pixel. Similar 
scanning methods using R. G, and B filters can be used for scanning of paper 

10 images and photographs, except that reflected light, rather than transmitted light, 
is recorded by the filters. 

In addition to direct coding systems, indirect coding systems, such as 
those utilized in digital film processing, have also been developed. Color film 
generally comprises three layers of light sensitive material that are separately 

15 sensitive to red, green, and blue light. During development, a light source is 
directed to the front of the film, and a light source is directed to the back of the 
film. Grains of elemental silver developing in the top layer (e.g., the blue 
sensitive layer) are visible from the front of the film by light reflected from the front 
source; however, these grains are hidden from the back of the film. Similarly, 

20 grains of elemental silver developing in the bottom layer (e.g.. the red sensitive 
layer) are visible from the back of the film by light reflected ft-om the back source; 
however these grains are hidden from the front. Meanwhile, elemental silver 
grains in the middle layer (e.g., the green sensitive layer) are hidden from the light 
reflected from the front or back; however, these grains are visible by any light 

25 transmitted through the three layers, as are those grains in the other two layers. 
Thus, by sensing, for each pixel location, light reflected from the front of the film, 
light reflected from the back of the film, and light transmitted through the film, 
three measurements can be acquired for each pixel. The three measured 
numbers for each pixel can then be solved for the three colors to arrive at color 

30 code values for each pixel. The color code values assigned to each pixel 
correspond to a particular location in the selected geometrical representation of 
the possible colors (i.e., in the selected "color space"). A variety of color spaces 



2 



wo 01/45042 



PCTAJSOO/32640 



have been developed for representing colors, including the L*a*b* color space, 
and the RGB color space, for example, and transfomiations have been developed 
for converting between various color spaces. 

Once the image data is captured, either by direct or indirect coding, the 
5 image data representing the image comprises pixel color code values, which may 
be manipulated, modified, displayed, printed, and/or stored. Signal processing 
operations are typically employed to modify or format the image data into a 
usable fomri. For example, to view the image on a monitor, the data is usually 
required to be in an RGB color code fomnat. When making a transformation from 
10 the data capture format, or color space, to the desired output format for the 
specific output device, a conventional colorimetric transformation is often used 
to translate the data to a standard encoding space, or to standard colorimetric 
values. 

During such transfomiations, additional modifications may also be made 
1 5 to the pixel color code values to deliberately alter the color or appearance of the 
output images from that which othenvise would have been produced using the 
original data. For example, spatial processing, such as sharpening or noise 
reduction, can be utilized to enhance the image quality. Moreover, color 
correction processes may be utilized in which correction coefficients are 
20 calibrated by scanning in a medium having known color patches and comparing 
the color difference between the captured code values and the known code 
values. Color correction equations, matrices, and/or look-up tables can then be 
established to carry out the color correction on images which are subsequently 
captured. 

25 While many such image enhancement transformations are beneficial, a 

disadvantage of conventional transformations is that portions of the color space 
may be adversely affected by such transfomnations. In particular, it has been 
found that spatial processing often adversely affects pixels of particular color 
code values (pixels which have color code values which lie in particular locations 

30 of the color space) while enhancing others. Another disadvantage in some 
implementations is that color correction processing may adversely affect 
achromatic (neutral) pixels. Yet another disadvantage in some implementations 
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is that color correction processes may adversely affect pixel code values which 
represent a color in one Dolor space, but not pixel code values which represent 
the same color in another color space. 

SUMMARY OF THE INVENTION 
5 According to one embodiment of the invention, light is applied to a medium 

which includes an image. Color code values are obtained for each of a plurality 
of pixels by detecting light reflected and/or transmitted from the medium, and it 
is determined whether a pixel has a color code value which falls within a 
predetermined range. The predetermined range had been identified as being 

10 adversely affected by an image enhancement transfomiation. The image 
enhancement transformation is applied to the pixel only if the pixel does not have 
a color code value which falls within the range. If the pixel does have a color 
code value within the range, a different transformation may be applied, or no 
transformation may be applied. 

15 An advantage of at least one embodiment of the invention is that pixels 

having color code values which may be adversely affected by an image 
enhancement transformation are sequestered so as to avoid the adverse affects 
of image enhancement transformations. 

Another advantage of at least one embodiment of the invention is that the 

20 pixels which fail in the range can be processed according to a separate 
enhancement transformation, such that the adverse effects are avoided and yet 
the color quality of the pixel is still enhanced. 

Still other advantages of various embodiments will become apparent to 
those skilled in this art from the following description wherein there is shown and 

25 described preferred embodiments of this invention simply for the purposes of 
illustration. As will be realized, the invention is capable of other different aspects 
and embodiments without departing from the scope of the invention. Accordingly, 
the advantages, drawings, and descriptions are illustrative in nature and not 
restrictive in nature. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
While the specification concludes with claims particularly pointing out and 
distinctly claiming the invention, it is believed that the same will be better 
understood from the following description taken in conjunction with the 
5 accompanying drawings in which like reference numerals indicate corresponding 
structure throughout the figures. 

FIG. 1 illustrates an embodiment of a color imaging system which includes 
selective image enhancement capability, according to principles of the present 
invention; 

10 FIG. 2 illustrates a digital film scanning operation which can be used to 

capture images in the system of FIG. 1 ; 

FIG. 3 is a flow diagram illustrating a method for selectively applying spatial 
processing to captured image data, according to one embodiment of the present 
invention; 

15 FIGS. 4a and 4b are tables illustrating example pixel code values before 

and after applying a biased spatial processing operation, according to an 
embodiment of the invention; 

FIG. 5 is a flow diagram illustrating a method for selectively applying a 
color correction transformation to non-neutral pixels, according to one 
20 embodiment of the invention; 

FIG. 6 is a graph illustrating neutral pixel locations in an exemplary color 
space prior to the operation of FIG. 5; 

FIG. 7 is a graph illustrating neutral pixel locations in the exemplary color 
space subsequent to the operation of FIG. 5; 
25 FIG. 8 is a flow diagram illustrating a method for applying color correction 

transformations in two separate color spaces and combining pixels from the two 
spaces after the operation, according to another embodiment of the present 
invention; 

FIG. 9 is a flow diagram illustrating a method of converting captured image 
30 data to a first color space, identifying adversely-affected pixels in the first color 
space and converting them to a second color space, and conducting color 
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correction in the two color spaces, according to another embodiment of the 
present invention; and 

FIG. 10 is an exemplary pixel map representing an image, each pixel 
having color code values in the L*a*b* space. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
In general, the present invention relates to a method and apparatus for 
selectively applying image enhancement transformations to certain pixels which 
make up an image data file, and to refrain from applying the transformations to 
other pixels in the file. In one embodiment, spatial processing transformations 
are avoided for pixels of particular colors which are known to be adversely 
affected by the spatial processing transformations. In another embodiment, color 
correction transfomnations are avoided for pixels which are neutral colors, or 
achromatic. These neutral colored pixels can have a separate gray-correction 
transfonnation applied in order to better separate the neutral colored pixels from 
the pixels of other colors. According to another embodiment, color code values 
for pixels are provided in a first color space. If a color correction transformation 
will have adverse affects on particular pixels in the first color space, then the color 
code values for those particular pixels are transformed to a second color space. 
Then, a first color correction transfonnation is applied to the pixels which are in 
the first color space, and a separate color correction transfomnation is applied to 
those pixels which are in the second color space. 

Turning now to the drawings in detail. FIG. 1 illustrates an embodiment of 
a color imaging system 19 which includes selective image enhancement 
capability, according to principles of the present invention. In this embodiment, 
the system 19 includes a digital image capture device 20. an image processing 
device 22, and an image output device 24. 

The image capture device 20 may comprise any device or system which 
produces or receives a digital imagei. For example, image capture device 20 may 
comprise an image scanner, digital camera, digital film processing system or 
other suitable image capture system. To store the digital representation, a 



6 



wo 01/45042 



PCT/US00A5264O 



computer readable medium may be used, such as a magnetic storage device, an 
optical storage device, or an electronic storage device. 

The digital image capture device 20 is in communication with an image 
processing device 22 and provides the digital image data, in its captured format, 
5 to the image processing device 22. The image processing device 22 may be 
embodied as an intemal or external computer system which generally includes 
a central processing unit and a memory, and which is capable of processing data 
in accordance with one or more instructions. For example, the image processing 
device 22 may comprise a personal computer, workstation, server, mainframe, 

1 0 microcontroller, or the like. Although shown in FIG. 1 as separate from the image 
capture device 20, the image processing device 22 can be incorporated integrally 
with the image capture device and/or with the image output device 24. 

The image processing device 22 processes the data representation of the 
captured image data file 21 which is received from the image capture device 20 

15 and which represents the captured image. One of the functions of the image 
processing device 22 is to transfomi the data 21 from the captured fomiat to 
output image data 23 for the desired output device 24. To achieve this function, 
the signal processing which is carried out in the image processing device 22 
typically includes a colorimetric transformation to translate the captured image 

20 data 21 to a standard encoding fonnat, or to standard colorimetric values. For 
example, it is often desirable to transform from the captured fomriat to a 
perceptually unifonn color space, such as the CIE L*a*b* color space, or the CIE 
L*u*v* color space. Because these two color spaces are based upon the CIE 
XYZ color space, it may be required to transform to the CIE XYZ color space to 

25 eventually arrive at the perceptually uniform color space. One advantage of 
perceptually uniform spaces is that a small perturbation to a component color 
value in such a space is approximately equally perceptible across the entire range 
of that value. Equations are known in the art for transforming to and from a 
perceptually uniform color space. 

30 The image processing device 22 may also make color transformations to 

the image data, preferably while it is in one of the perceptually uniform formats, 
but potentially while it is in other formats. For example, it may be desirable to 
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perform a color gamut cor ection in order to account for discrepancies between 
input-image viewing conditions and encoding reference viewing conditions for the 
particular color capture foimat which is utilized. Such a color gamut correction 
can be achieved by adjusting each pixel code value with respect to some 
5 standard reference colors. For example, in a film scanning application, a target 
image with specific color patches can be recorded on photographic film and 
scanned in the capture fomiat. The pixel code values can then be transfomned 
to a unifomily perceptible color space, such as the L*a*b* color space. Then, the 
pixel code value averages (or means) for each of the patches can be calculated. 
10 and a matrix can be calculated for regressing the average values against those 
which are known for the patches. The matrix can then be applied to every pixel 
code for every image processed thereafter in order to achieve color gamut 
correction. 

In addition to color transformations, the image processing device 22 may 

1 5 also have the capability to perform other image enhancing transfomnations, such 
as spatial processing transfonnations for example. Any operation which involves 
adjusting a pixel code value based upon the code values for one or more 
neighboring pixels is referred to herein as a spatial transfomnation or spatial 
processing. For example. FIG. 10 shows an exemplary pixel array representing 

20 a portion of an image. Perfomiing a spatial transfomnation on pixel 10 might 
involve adjusting the L^q, a^o. and/or b^o value for pixel 10 based upon the three 
L, a. and b values for pixels 5,6,7.9.11,13.14 and/or 1 5. Two exemplary types 
of spatial transfonnations are sharpening and noise reduction. Such 
transfonnations involve, for each particular pixel, averaging the pixel code values 

25 for a given number of pixels surrounding the particular pixel, and using the 
average to adjust the pixel code value for that particular pixel. 

However, according to principles of the present invention, the image 
processing device 22 includes capability to conduct image enhancement 
transformations, such as color correction transformations and/or spatial 

30 processing transfonnations, on a selective basis, depending on the pixel code 
value for the given pixel. In the embodiment of FIG. 1 . three such selective image 
enhancement functions 29 are provided: biased spatial processing 30, neutral 
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pixel sequestering 32. and pixel replacement 34. One or more of these three 
types of image enhancement functions 29 can be conducted on the captured 
image data 21 before outputting the output image date 23 to the output formation 
device 24. 

5 The biased spatial processing function 30 of this embodiment applies 

spatial processing to the image data. However, rather than applying the spatial 
processing to all of the pixels which represent the image, the spatial processing 
is only applied to the pixels which meet a certain select criteria. In this way. the 
spatial processing is biased to include or exclude pixels. 

10 Preferably, pixels are selected by the biased spatial processing function 

30 based upon the location of the pixel code values in the color space which is 
utilized. In other words, it is prefenred that a pixel is selected based upon whether 
its code values represent a point that falls within a range of locations in the color 
space (i.e. a range of colors) which has been determined to be adversely affected 

15 by spatial processing. More specifically, if three code values are used to 
represent the color for that pixel, than those three values represent a particular 
point in a three-dimensional color space. The position of that.particular point in 
the color space will determine whether the biased spatial processing function 30 
applies a spatial transfomnation to that pixel. 

20 For example, it has been found that sharpening can increase image noise, 

and that an increase in image noise can be more apparent in sonrie colors than 
in others. For instance, image noise can be particularly noticeable in yellows in 
digital film processing. The biased spatial processing function 30 can 
discriminate the yellow pixels and not have the particular spatial process (such 

25 as sharpening) applied to them, even though it is applied to the non-yellow pixels. 

A number of methods can be utilized for achieving biased spatial 
processing. For instance, the spatial processing can be applied on a pixei-by- 
pixel basis, and for those pixels with color code values within the predetermined 
range or ranges, the spatial processing will not be applied and will skip to the next 
30 pixel. 
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In addition, rather than applying no spatial processing to the select pixels, 
it may be desirable to reduce the spatial processing applied to these pixels, by 
applying a different type of spatial processing to them. Thus, some of the 
benefits of spatial processing can be achieved for these pixels, yet the adverse 
effects (e.g.. image noise) will be minimized. 

The image processing device 22 may also include a neutral pixel 
sequestering function 32. While image enhancement transformations, such as 
color correction transformations, may provide good results for colored pixels, such 
transfonnations may adversely affect achromatic, or neutral pixels. For example, 
gray pixels, after color connection, can appear tinted toward green or magenta. 
However, the neutral pixel sequestering function 32 identifies the pixels that are 
supposed to be neutral, by selecting those pixels having a color code value within 
a range that is near the neutral color code values. These select pixels then either 
be excluded from the color correction transformation, or can be processed 
differently according to a special corrective transformation which ensures that the 
neutral pixels appear even more neutral. Accordingly, the best color correction 
processing is achieved without adverse affects to the neutral pixels. The color 
correction transformation can be perfonned on a pixel-by-pixel basis, with the 
neutral pixels being skipped, or can be perfonned to the entire pixel set. with 
neutral pixels later being replaced with their original values or with separately 
processed values. 

The embodiment of FIG. 1 also preferably includes a pixel replacement 
function 34, The pixel replacement function 34 preferably applies color correction 
transformations to the pixel code values in two separate color spaces. In digital 
film processing applications, color correction transformations conducted in one 
color space may adversely affect some pixels while the same color correction 
transformations conducted in a separate color space may not adversely affect 
these pixels (but may adversely affect different pixels). Accordingly, the pixel 
replacement function 34 of this embodiment transforms the image data to a first 
color space and conducts a first color correction transfomiation in this first color 
space. Prior to the first transformation, the adversely-affected pixels from the first 
space are identified and replaced with corresponding color code values from a 
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second color space. A second color correction transfonnation is then conducted 
for these identified pixels in the second color space. Accordingly, a combined set 
of code values results for the image, some pixel code values being in the first 
color space (and having the first transformation applied to them) and some pixel 
code values being in the second color space (and having the second 
transfomiation applied to them). This combined set minimizes the number of 
adversely- affected pixels, and thereby minimizes the adverse affects of the first 
color correction transfonnation. 

Alternatively, color correction can be conducted on the entire image data 
set in two separate color spaces. Then, a combined set can be formed from the 
two color spaces after the color correction, the combined set comprising some 
pixels having code values from the first color space and other pixels having code 
values from the second color space. Whether the color code values for a given 
pixel are chosen from the first or the second color space is determined by 
whether the color represented by the code values has been adversely affected 
by the color correction transfomiation in either of the two spaces. 

The combined set of code values can then be converted to the final output 
format, according to a suitable transformation from the first space to the output 
format (for those pixels having code values in the first space) and according to a 
suitable transformation from the second space to the output format (for those 
pixels having code values in the second space.) Thus, this pixel replacement 
function 34 ensures that all areas of an image are adequately color corrected by 
replacing a pixel's code values in an adversely-affected color space with 
corresponding pixel code values from a separate color space and applying a color 
correction transformation in that separate color space. 

Once image processing has been completed by the processing device 22, 
the device can transform the image data to the image output data 23 required by 
the image output device 24. Any suitable transformation from the color space in 
which the processing took place prior to the final output fomiat may be utilized. 
The transformed image can then be produced in the image output device 24 
(such as a printer, monitor, and the like). 
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FIG. 2 illustrates one embodiment of a digital film processing system 40, 
which may be used as the image capture device 20 of the system of FIG. 1 . The 
digital film processing system 40 of this embodiment comprises a front light 
source 42 and a back light source 44, each being configured to apply infrared 
light to a film 60 having a developing image formed thereon. Additional optics 
may be positioned between each of the light sources 42 and 44 and the film 60 
in order to enhance the illumination provided, such as to make the illumination 
more uniform for example. Preferably, the light sources 42 and 44 apply infrared 
light to the film 60. The front light source 42 applies light to the front 62 of the film 
60, and the back light source 44 applies light to the back 64 of the film 60. Any 
appropriate infrared light source may be utilized for this purpose, such as infrared 
light-emitting diodes (LED's), emitters, and/or photodiodes for example. Filters 
or wavelength modifiers or limiters may be included with the light sources 42 and 
44 to aid them in applying visible light to the film 60 . Light applied to the film 60 
by the sources 42 and 44 is attenuated by the elemental silver grains that are 
forming the image. A pair of sensors. 56 and 58. are provided in order to record 
the amount and/or type of reflected and/or transmitted light. Optics, such as 
lenses 52 may also be provided in order to focus or othenvise direct the light 
reflected by and/or transmitted through the image onto the sensors 56 and 58. 

The film 60 generally comprises a clear film base and three photo-sensitive 
layers which are separately sensitive to different light wavelengths, such as red, 
blue and green for example. During development of the film 60, the light sources 
42 and 44 project light to the front 62 and the back 64 of the film respectively. For 
each portion of the image, or "pixel", sensor 56 captures light reflected from the 
front 62 of the film 60, and sensor 58 captures light reflected fl-om the back 64 of 
the film 60. Light from front light source 42 which transmits through the film 60 
is also captured by sensor 58, and light from light source 44 which transmits 
through the film is also captured by sensor 56. Accordingly, four code values for 
each pixel can be obtained: the amount of reflected light sensed by the back 
sensor 58, the amount of transmitted light sensed by the back sensor 58, the 
amount of reflected light sensed by the front sensor 56, and the amount of 
transmitted light sensed by the front sensor 56. Often, only the transmitted light 
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from one of the light sources is utilized in the image data, such as the amount of 
light transmitted by the source 44 and sensed by the front sensor 56. The light 
sources 42 and 44 are generally alternately illuminated when acquiring the image 
data. In addition, a complete set of image data comprising pixel color code values 
5 may be taken during multiple development times of the film 60, such that various 
features of the image are recorded. The multiple sets of pixel code values can 
then be combined to form a signal enhanced image data set. 

The sensors 56 and 58 utilized in this embodiment could comprise any 
suitable light responsive sensor, such as a phototransistor, a photoresistor, a 

10 charge coupled device (CCD), a time delay integration array, or other light 
responsive device. A plurality of individual sensor elements may be arranged in 
an array to scan a region or line or column of the image with one illumination. 

It may also be desirable to utilize analog-to digital converters (A/D 
converters) to convert the data from the sensors 56 and 58 into digital data, and 

15 to utilize pre-processor circuitry to convert the digital data before image 
processing begins. Generally the acquired digital data comprises three numeric 
values (B, F, and T) for each pixel in the image, the three values corresponding 
to the back reflected light intensity (B). front reflected light intensity (F). and the 
transmitted light intensity (T). By sensing light reflected from the front and the 

20 back of the film, and light transmitted through the film, each pixel in the film yields 
three measured numbers that may be solved for the three colors, such as by 
using a matrix transfomiation as described in U.S. Patent No. 5.519,510 for 
example, which is hereby incorporated herein by reference. Once solved for the 
three colors, one or more of selective image enhancement processes (such as 

25 the biased spatial processing function 30. neutral pixel sequestering function 32. 
and/or pixel replacement function 34) can be applied using an image processing 
device 22. These processes may be carried out in one or more color spaces. 
A final conversion to the output format may be required once image processing 
is complete. 

30 FIG. 3 is a flow diagram illustrating a method for applying biased spatial 

transformations to captured image data, according to another embodiment of the 
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present invention. According to this embodiment, the pixel code values are 
captured at step 300. 

Then, at step 302. it is detennined which pixels have code values which 
are within a target color range which is known to be adversely affected by the 
5 spatial transformation to be conducted. For example, sharpening can have an 
adverse effect on yellows, so it may be desirable to avoid applying sharpening to 
pixels having code values within the yellow range. One way to achieve this step 
would be to compare the pixel code values for the pixel with the range of code 
values which define yellow colors, and. if the pixel code value falls within the 

1 0 range, to identify the pixel as being within the range. For example, the pixel code 
values can be transformed into L*a*b* space. Then, yellow pixels can be 
discriminated by determining whether the a* and b* values for the pixel fall within 
the a* and b* ranges within which all yellows will fall. (In L*a*b* color space, the 
a* and b* values specify the color.) In particular, pixels having a* values of 

1 5 around zero and b* values of greater than 70 can be selected. Altematively. the 
pixels can be transformed into a color space that has cylindrical coordinates, such 
as the HSI (Hue, Saturation, and Intensity) color space. The first value, hue (H). 
is an angle from 0-360 degrees, and this single values specifies the color of the 
pixel in the HSI color space. Thus, any target color, such as yellow, can be 

20 readily identified by comparing the H value for the pixel to a pre-determined range 
of hue angles which represent the target color. 

Once pixels residing in the target color range(s) are identified, step 304 
can be executed. At this step, the spatial transformation operation is performed 
on the pixels which are not in the target color range (s). For example, pixels 

25 which have been marked as falling within the yellow range can be excluded from 
the spatial transformation. Alternatively, if the transfomnation operation is 
performed on these pixels, the transformation operation can be reversed, such 
as by returning the pixel code values for these pixels to their original values. 
As another alternative, a different spatial transformation can be conducted 

30 on these pixels. This step is shown as step 306 in the embodiment of FIG. 3. At 
this step, a reduced spatial transfomriation is perfomied on the pixels in the range, 
such that the pixel code values for these pixels are not changed as much as 
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would have occurred if the spatial transformation of block 304 had been 
conducted on them. Accordingly, less noise will be introduced into the code 
values for these pixels. 

FIGS. 4a and 4b are data tables which provide an example of how pixel 
5 data might change during a biased spatial transformation operation, such as the 
transformation discussed with respect to FIG. 3. As shown in these figures, a 
plurality of pixels 400 are provided in a data image file to represent the image, 
each pixel having a code value which represents the color 408 of the image at 
that pixel. In this example, the code values are provided as a back value 402. a 

10 front value 404, and a through value 406. which in combination represent the 
color 408 of the image at that pixel. After applying the spatial transfomiation. one 
or more pixel code values are altered by an amount A. as shown in FIG. 4b. 
However, as can be seen by comparing FIG. 4a with FIG. 4b. not all of the code 
values are altered. In particular, the code values corresponding to colors a. c. 

15 and d are altered by various amounts A. However, the code values for color b 
are not altered at all. The reason color b is not altered by the biased spatial 
transformation is because this color had been previously identified as being 
adversely affected by spatial transfomiations. Accordingly, the adverse affects 
are avoided by not applying the spatial transfomiation to the pixels having code 

20 values which represent color b (or a variant of color b). 

FIG. 5 is a flow diagram illustrating a method for selectively applying a color 
correction transformation to non-neutral pixels, according to one embodiment of 
the present invention. In this embodiment of neutral pixel sequestering, the 
image data is captured at step 500. Then, this data is converted to a 

25 standardized color format, at step 502. For example, the data can be converted 
to the CIE L*a*b* color space, such as by using an appropriate transformation 
matrix equation. Then, at block 504. it is detemriined which pixels are in the 
predetermined neutral range. For example, in the L*a*b* color space, gray pixels 
have a* and b* values which are very near to zero. However, a color correction 

30 method might change these values such that they become tinted toward 
particular colors. Thus, pixels having a* and b* values within a certain range of 
zero should be sequestered. 



15 



wo 01/45042 



PCT/USOO/32640 



The process then continues to step 506 and the non-neutral pixels can be 
color corrected. In the L*a*b* example, those pixels having a* or b* values 
outside of the neutral range can be color con-ected. Again, this biased color 
correction transfomiation can occur in a number of manners, such as on a 
selective pixel-by-pixel basis for example, or by correcting the entire image data 
set and returning the pixels within the range to their original values. 

While the non-neutral pixels are color corrected, either a different 
correction transformation can be applied to the neutral pixels, or no con-ection 
transfomiation can be applied. In the embodiment of FIG. 5, the neutral pixels 
are corrected according to a gray-correction transfomiation which provides better 
separation between the neutral pixels and the colored pixels. This is shown at 
block 508 of FIG. 5. In the L*a*b* example, the pixels having a* and b' values 
within the predefined range near zero can have their a* and b* values brought 
closer to zero, to force these pixels to appear more gray. 

Once the corrections have been completed on the pixels, the pixel color 
code values can be converted to the appropriate output data format for the output 
device on which the image will be fomied. This step is shown as block 510 of 
FIG. 5 

FIG. 6 is a graph illustrating an example of neutral pixel a* and b* values 
prior to the transfomiation of FIG. 5. and FIG. 7 is a graph illustrating these 
exemplary neutral pixel a* and b* values subsequent to the transformation of FIG. 
5. Each graph is a plot of a* values versus b* values for a plurality of colors. 
(The L* axis is not shown). More specifically, each number on the graphs 
represent the mean a* and b* values for one of 84 target color patches scanned 
from a standard color target film, such as by using the scanning system of FIG. 
2. The colors represented by these 84 numbers are various saturations of cyan, 
magenta, yellow, gray, red, green, and blue. It is known from the target film that 
the gray patches are colors 37-48. While these colors should have a* and b* 
values very close to zero, as shown in FIG. 6. these colors deviate from the point 
(0. 0). Thus, some of these colors may actually appear tinted towards red. Also, 
in some imaging systems, such neutral colors can appear tinted towards green 
and magenta. 
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According to one embodiment of neutral pixel sequestering, any pixel 
having code value which represents one of the neutral colors 37-48 are exempted 
from the color correction which occurs to pixels having one of the other code 
values. These colors can be discriminated because they have a* and b* values 
within certain ranges. As shown in FIG. 7, any pixels representing neutral colors 
37-48 have been subjected to a gray-correction transformation which moves their 
a* and b* values closer to a point z which is near the point (0,0). As an 
alternative, all of these pixels can be moved to the same point z. In contrast, any 
pixels representing other colors are subjected to a color correction transfonnation 
to adjust their L*, a*, and/or b* values. The application of the color correction 
transformation is shown by the an-ows in FIG. 7. This is an example of an 
embodiment where the gray colored pixels are not only exempted from the color 
correction transformation, but actually subjected to a separate gray-correction 
transformation to enhance their gray appearance. 

FIG. 8 is a flow diagram illustrating a transformation method for applying 
color correction in two separate color spaces and combining pixels from the two 
spaces after the transfonnation, according to an embodiment of the present 
invention. In this embodiment, the image data is captured at step 800. such as 
In a BFT fomiat for example. Then, the data is converted to a linear-light color 
space, such as the linear RGB space for example, at step 802, using a 
transformation equation. From this linear-light color space, the data is converted 
to two other color spaces: Color Space 1 and Color Space 2. The conversion 
from the linear-light space to Color Space 1 is shown at block 804 of FIG. 8. and 
the conversion from the linear-light space to Color Space 2 is shown at block 806 
of FIG. 8. Accordingly, each pixel in the image data has two sets of code values, 
one set being in Color Space 1 and the other set being in Color Space 2. 

Then, color correction is applied to all of the pixel code values in Color 
Space 1. This step is shown at block 808 of FIG. 8. Similarly, color correction is 
conducted on all of the pixel code Values in Color Space 2. This is shown at 
block 810 of FIG. 8. 

The color correction process of block 808 may be earned out by scanning 
in a medium having target color patches and comparing the color difference 
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between the captured code values (which are in Color Space 1) and the target 
code values (which are also in Color Space 1). Color connection coefficients for 
Color Space 1 can then be calculated, and equations, matrices, and/or look-up 
tables can then be established to carry out the color correction on the pixel code 
5 values in Color Space 1 . A similar color correction process can be conducted for 
the color correction transfonnation of block 810. except that the captured code 
values, the target code values, and the established connection coefficients and 
algorithms are in Color Space 2. 

However, the color con-ections conducted in steps 808 and 810 may have 

10 adverse affects on certain pixels in Color Space 1 . and on other pixels in Color 
Space 2. Subsequently, non-adversely-affected pixels ("good" pixels) are 
identified from Color Space 1 and from Color Space 2, These steps are shown 
as blocks 812 and 814 of FIG. 8. 

It can be detennined by experimentation which color code values will be 

1 5 adversely affected by a given color con-ection. Any appropriate color difference 
method or equation can be used to determine whether a given color will deviate 
adversely deviate from its target color after color confection. For example, Delta 
E*. Delta L*, Delta H*. and/or Delta C* calculations can be made to detennine the 
color difference between a con-ected color code value and its target value. 

20 Accordingly, pixel code values which fall within a certain color range may 

be identified, in any suitable manner, as being adversely affected by the color 
correction which is performed in the color space. As an example, the color code 
values for each pixel can be compared to a color code value range known to be 
adversely affected by color correction. For instance, if the L*a*b* space is used. 

25 it may be desirable to replace all pixels having a b* value greater than 70 and an 
a* value of approximately zero (i.e.. yellow pixels) with another set of pixel code 
values from another space, because it has been found that color correction can 
adversely affect yellow pixels when conducted in the L*a*b* color space. 
Accordingly, prior to color connecting in the L*a*b* space, any pixels with a b* 

30 value greater than 70 and an a* value of about zero can be identified and 
converted to the HSI color space. Color correction for these pixels can then be 
conducted in the HSI color space, and improved accuracy for yellows results. 
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Thus, for the adversely-affected pixels in Color Space 1 , the code values are 
preferably replaced with color-corrected code values from Color Space 2. 

The selection and/or combination of non-adversely affected code values 
from the two color spaces for the pixels is shown at block 816 of FIG. 8. Once 
this good data has been selected from each color space, each pixel will have 
color code values from either Color Space 1 or Color Space 2. These code 
values can then be converted by a transformation equation to an appropriate 
output fomnat for image formation, as shown at block 818. 

Accordingly, this embodiment achieves maximum color correction of an 
image and minimizes the adverse affects that can result from cofor correction 
transfomnations. Pixels representing adversely-affected colors have their color 
code values replaced with color code values from other color spaces where no 
adverse effects resulted after color correction. 

FIG. 9 is a block diagram illustrating an alternative pixel replacement color 
correction method. In this embodiment, the image is captured in the input color 
space, at block 900. Preferably, the input color space comprises the BFT color 
space described above. Then, the method proceeds to convert from the input 
color space to a first color space, such as the L*a*b* color space, at block 902. 
As shown in the exemplary pixel map 903, after converting to the first color space, 
each pixel has L*, a*, and b* code values. For example, pixel 920 represents the 
upper left corner of the image. The color of the image at this pixel is represented 
by L*a*b* values in the map 903. 

However, some of the pixels, after being converted to the first color space, 
have a color code value which is in a predefined range that is known to be 
adversely affected by color correction processing. These pixels are marked with 
an X in the map 903 of FIG. 9. The pixel 924 is an example of such a pixel. In 
the L*a*b* example, this pixel might have a b* value greater than 70 and an a* 
value of around zero, indicating that it is a yellow pixel which can be adversely 
affected by color correction in the L*a*b* color space. Such pixels can be 
identified by comparing their color code values to those color code values known 
to be adversely affected by color correction. This identification step is shown at 
block904of FIG. 9. 
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The identified pixek; can then be converted to a second color space, such 
as the HSI color space for example. This step is shown at block 906. The result 
is that each pixel has one set of code values, either from the L*a*b* space or from 
the HSI space, as shown by the pixel map 907. As shown in the map 907, 
5 because the pixel 924 was identified as being an adversely-affected pixel in the 
L*a*b* space 903, it is re-assigned a corresponding HSI code value, such as by 
converting its L*a*b* values to corresponding HSI values using an appropriate 
color space transfomriation (Alternatively, this pixel could be converted from its 
original BFT values to HSI values). Similarly, because pixel 922 was identified 

10 as an adversely-affected pixel in the first color space 903 (e.g., L*a^b* space), it 
is converted to a second color space value (e.g., an HSI value). 

Thus, the map 907 contains no pixel code values which are known to be 
adversely affected by color correction processing in the first color space. Rather, 
the adversely-affected pixels have been transformed from the first color space to 

15 the second color space. Accordingly, each pixel in the map 907 has color code 
values from either the first color space or the second color space. Thus, more 
accurate and higher quality color correction can be achieved. 

Once the code values have been converted at step 906, color correction 
(and/or spatial processing) is conducted, such as by correcting the HSI and 

20 L*a*b* pixel values using a suitable color correction look-up table, matrix 
transfomriation. or equation. In particular, the pixels having L*a*b* values are 
corrected using an appropriate L*a*b* color correction transformation, as shown 
at block 908. Similarly, the pixels having HSI values are corrected using an 
appropriate HSI color correction transfomriation, as shown at block 909. The 

25 resulting pixel map 911 has corrected color code values, each pixel having a 
corrected value from either the first or the second color space. 

After this image enhancement processing, the resulting pixel code values 
can then be converted to the appropriate output format, such as an RGB format, 
for example. This step is shown at block 910. A suitable transfomriation can be 

30 used to move the pixel data from the HSI space to the RGB space or from the 
L*a*b* to the RGB space (depending on the pixel), such as the transformation 
equations known in the art. In the example of FIG. 9, pixel 920 will need to be 
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transformed from the L*a*b* space to the RGB space, while pixels 922 and 924 
will need to be transformed from the HSI space to the RGB space. 

The various exemplary methods described above can be implemented in 
a number of ways, such as by providing a set of software instructions on a 
computer readable medium, or by providing a programmable apparatus having 
executable instructions suitable for carrying out the steps stored in a RAM and/or 
ROM. 

The foregoing descriptions of the preferred embodiments of the invention 
have been presented for purposes of illustration and description only. They are 
not intended to be exhaustive or to limit the invention to the precise forms 
disclosed, and modifications and variations are possible and contemplated in light 
of the above teachings. While a number of preferred and alternate embodiments, 
methods, systems, configurations, and potential applications have been 
described, it should be understood that many variations and alternatives could be 
utilized without departing from the scope of the invention. Moreover, although a 
variety of potential configurations and components have been described, it should 
be understood that a number of other configurations and components could be 
utilized without departing from the scope of the invention. 

Thus, it should be understood that the embodiments and examples have 
been chosen and described in order to best illustrate the principals of the 
invention and its practical applications to thereby enable one of ordinary skill in 
the art to best utilize the invention in various embodiments and with various 
modifications as are suited for particular uses contemplated. Accordingly, it is 
intended that the scope of the invention be defined by the claims appended 
hereto. 
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WHAT IS CLAIMED IS: 

1 . A method for enhancing an image represented by a plurality of pixels, the 
method comprising: 

obtaining color code values for each of a plurality of pixels; 

detennining whether a pixel has a color code value within a predetermined 
range, wherein the predetermined range has been identified as being adversely 
affected by a first processing transfomiation; and 

applying the first processing transformation to the pixel only if it does not 
have a color code value which falls within the range. 

2. The method as recited in claim 1, wherein the first processing 
transformation comprises a spatial processing transformation. 

3. The method as recited in claim 1. wherein the first processing 
transformation comprises a color correction transformation in a first color space. 

4. The method as recited in claim 1, wherein the predetemiined range 
comprises color code values representing yellow colors. 

5. The method as recited in claim 1 , wherein the color code values comprise 
L*a*b* color space values. 

6. The method as recited in claim 1. wherein the first processing 
transformation comprises a noise reduction transfomiation. 

7. The method as recited in claim 6, wherein the noise reduction 
transformation comprises a sharpening operation. 

8. The method as recited in claim 1, wherein the steps are conducted by a 
digital film processing system. 



22 



wo 01/45042 



PCT/USOO/32640 



9. The method as recited in claim 1 , wherein the steps are conducted by an 
image scanner system. 

10. The method as recited in claim 1, further comprising: 

applying a second processing transformation to the pixel if it does have a 
color code value which falls within the range. 

11. A method for enhancing an image represented by a plurality of pixels, the 
method comprising: 

applying light to a film medium which includes an image; 
recording at least one value representing the amount of light from the film 
5 medium; 

transfomriing the at least one value to a set of code values representing a 

color; 

determining whether the color falls within a predetermined color range, 
wherein the predetermined color range has been identified as being adversely 
10 affected by a first image enhancement transfomriation; and 

applying the first image enhancement transformation to the set of code 
values only if the color does not fall within the predetermined color range. 

12. The method as recited in claim 1 1 , wherein the first image enhancement 
transformation comprises a spatial transfornnation. 

1 3. The method as recited in claim 1 1 , wherein the predetermined color range 
comprises color values represenfing yellow colors. 

14. The method as recited in claim 1 1 , wherein the predetermined color range 
comprises color values representing achromatic colors. 

15. The method as recited in claim 11. wherein the at least one value 
represents the amount of light reflected from the front of the film medium, and 
wherein the transforming step comprises: 
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recording a back value representing the amount of light reflected from the 
back of the film medium; 

recording a transmitted value representing the amount of light transmitted 
through the film medium; and 

transforming the front, back, and transmitted values to the set of code 
values. 

16. A method for enhancing an image represented by a plurality of pixels, the 
method comprising: 

obtaining original code values for a plurality of pixels; 

transforming the original code values to first code values in a first color 

space; 

identifying which pixels have first code values which fall within a 
predetermined range of the first color space; and 

for the identified pixels, transfomiing the original code values for the pixels 
to second code values in a second color space, applying a color correction 
process to the second code values, and transfomiing the corrected second code 
values to a final color space. 

17. The method as recited in claim 1 6. wherein the first color space comprises 
the HSI color space. 

1 8. The method as recited in claim 1 6. wherein the first color space comprises 
the L*a*b* color space. 

19. The method as recited in claim 18. wherein the predetemnined range 
comprises first code values having a b* value greater than about 70. 

20. The method as recited in claim 16, wherein the first color space comprises 
the L*a*b* color space and the second color space comprises the HSI color 
space. 
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21. The method as recited in claim 16, further comprising: 

for the pixels which do not have first code values which fall within the 
predetermined range, color correcting the first code values, and transforming the 
corrected first code values to the final color space. 

22. The method as recited in claim 16, wherein the steps are conducted in an 
image scanner. 

23. The method as recited in claim 16, wherein the steps are conducted in a 
digital film processing system. 

24. The method as recited in claim 16. further comprising: 

detecting reflected light from an image to obtain the original code values. 

25. A method of color correcting image data, the method comprising: 
obtaining color code values for a plurality of pixels representing an image; 
detemiining which pixels have color code values which fall within a 

predetermined neutral color range; and 
5 applying a color correction process to the pixels which have color code 

values which do not fall within the predetermined neutral color range. 

26. The method as recited in claim 25, further comprising: 

applying a gray-correction process to the pixels which have color code 
values which do fall within the predetermined neutral color range. 

27. The method as recited in claim 25. wherein the color code values are in 
the L*a*b* color space. 

28. The method as recited in claim 27, further comprising: 

adjusting the a* and b* values of the pixels having color code values which 
fall within the predetermined neutral range, such that the a* and b* values of 
these pixels are closer to zero. 
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29. The method as recited in claim 25, further comprising: 
transfomriing the color code values to an output color space. 

30. A color imaging system comprising: 

a digital image capture device adapted to capture color code values for 
each of a plurality of pixels; and 

an image processing device in communication with the digital image 
5 capture device, wherein the image processing device is adapted to determine 
whether a pixel has a color code value within a predetermined range which has 
been identified as being adversely affected by a first processing transformation, 
and to apply the first processing transformation if the pixel does not have a color 
code value which falls within the range. 

31 . The color imaging system as recited in claim 30, wherein the digital image 
capture device comprises a scanner. 

32. The color imaging system as recited in claim 31. wherein the scanner 
comprises a film scanner. 

33. The color image system as recited in claim 30, wherein the image 
processing device comprises a computer. 

34. The color image system as recited in claim 30, wherein the image 
processing device is further adapted to apply a second processing transformation 
if the pixel does have a color code value which falls within the range, 

35. The color image system as recited in claim 34, wherein the first processing 
transformation comprises a color correction transformation in a first color space, 
and the second processing transformation comprises a color correction 
transfomriation in a second color space. 
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36. The color image system as recited in claim 30, wherein the predetermined 
range comprises neutral color codes. 

37. The color image system as recited in claim 30, wherein the predetennined 
range comprises yellow color codes. 

38. The color image system as recited in claim 30. wherein the first processing 
transformation comprises a color correction transfomriation. 

39. The color image system as recited in claim 30, wherein the first processing 
transformation comprises a spatial processing transformation. 

40. A stored image data file comprising: 

a first set of pixels, wherein each pixel in the first set has a color code 
representing a predetermined color which is adversely affected by a first image 
processing transformation; and 
5 a second set of pixels, wherein each pixel in the second set has a color 

code representing a color which is not adversely affected by the first image 
processing transformation, and wherein each pixel in the second set has a color 
code which has been transformed by the first image processing transformation. 

41. The image data file as recited in claim 40, wherein each pixel in the first set 
has a color code which has been transformed by a second image processing 
transformation. 

42. The image data file as recited in claim 41 , wherein the first image processing 
transfomiation comprises a color correction transformation in a first color space, 
and the second image processing transformation comprises a color correction 
transfomiation in a second color space. 
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43. The image data file as recited in claim 42, wherein the first color space 
comprises the L*a*b* coloi space and the second color space comprises the HSI 
color space. 

44. The image data file as recited in claim 40, wherein the first image 
processing transformation comprises a sharpening operation. 

45. The image data file as recited in claim 40. wherein the predetemiined color 
comprises yellow. 
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